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8.2.5 Solved Problems 


Problem 1 

Let X be the height of a randomly chosen individual from a population. In order to estimate the 
mean and variance of A, we observe a random sample A|,A 2 ,---,A 7 . Thus, X-s are i.i.d. and 

have the same distribution as X. We obtain the following values (in centimeters): 

166.8, 171.4, 169.1, 178.5, 168.0, 157.9, 170.1 

Find the values of the sample mean, the sample variance, and the sample standard deviation 
for the observed sample. 

• Solution 


o 


■ x 1 +x 2 +x 3 +x 4 +x 5 +x 6 +x 7 


166.8 + 171.4 + 169.1 + 178.5 + 168.0 + 157.9 + 170.1 

7 

= 168.8 


The sample variance is given by 

7 

S 2 = —£(**- 168.8) 2 = 37.7 
7 1 k= l 


Finally, the sample standard deviation is given by 

= ^~S 2 = 6.\ 


The following MATLAB code can be used to obtain these values: 
x=[166.8, 171.4, 169.1, 178.5, 168.0, 157.9, 170.1]; 


m=mean(x); 
v=var(x); 
s=std(x); 


Problem 2 

Prove the following: 
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a. If 0 j is an unbiased estimator for 9, and W i s a zero mean random variable, then 

0 2 = 0j + W 


is also an unbiased estimator for 6. 

b. If 0 j is an estimator for 9 such that E[Q J = a9 + b, where a f 0, show that 


is an unbiased estimator for 9. 

• Solution 

o a. We have 



0 , 


-b 


a 


E[® 2 \ =E[® x \+E[W\ 

= 9 + 0 
= 9. 


(by linearity of expectation) 
(since 0, is unbiased and EW = 0) 


Thus, 0 2 is an unbiased estimator for 9. 
b. We have 


E[® x \~b 

fs[0 9 ] = -(by linearity of expectation) 

z a 

a9 + b ~ b 
a 

= 9. 

Thus, 0 O is an unbiased estimator for 9. 


Problem 3 

Let W|, X 2 , X 3 , . .., X n be a random sample from a Uniform (0, 9) distribution, where 9 is 
unknown. Define the estimator 


0 


n 


max {X lt X 2 , —,X n ). 


a. Find the bias of 0 W , 5(0 W ). 
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b. Find the MSE of 0„, MSE(® n ). 

c. Is 0 ;; a consistent estimator of 61 

• Solution 

o If X ~ Uniform (0, (9), then the PDF and CDF of X are given by 


ffx) = 


and 


0 < x < 6 


0 otherwise 


X 

0 


Fjfx) 


0 <x<6 


0 otherwise 


By Theorem 8.1, the PDF of & n is given by 

/© (v) = nfjfpc)[Fjfx)] n 1 


ny 


n — 1 


e n 


0 <y<6 


otherwise 


a. To find the bias of 0 , we have 


c 0 ny 

£ [ 0 «] = kv • ~yr d y 


n -1 


6 h 


n + 1 


- 6 . 


Thus, the bias is given by 
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b(®„) = E[® n ] - e 

n 

9-9 


n + 1 


9 


n + 1 


b. To find MSE(® n ), we can write 


MSE(® n ) = Var(0 w ) + B(® n Y 


9 2 


= Var(0 ) +- 2 - 

n (n + l) 2 


Thus, we need to find Var(0). We have 


0 , 


0 ? n y 


n — 1 




9 n 


-dv 


n + 2 


9 Z . 


Thus, 


Var(0 w ) = E 


0 , 


- (n@„]) : 


Therefore, 


c. Note that 


;9 Z . 


(n + 2)(n + 1 Y 


n 9 9 Z 

MSE(® ) = - ~9 2 + -; 

(n + 2)(n + l) 2 (n + \y 

2 9 2 


(n + 2)(n + 1)' 


lim MSE(® ) = lim 


2 9 1 


n —>oo 


„^ao( n + 2)0 + 1 ) 


= 0. 


Thus, by Theorem 8.2. 0 H is a consistent estimator of 
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Problem 4 

LetXj, X 2 , X 3 , . .., X n be a random sample from a Geometric{9 ) distribution, where 9 is 
unknown. Find the maximum likelihood estimator (MLE) of 9 based on this random sample. 

• Solution 

o If Xj ~ Geometric(O), then 


P x (x- 9) = (1 - Of '(). 

Thus, the likelihood function is given by 

L ( X 1 ’X 2 , -,x n ; 9) = P x .x 7 -X ( x l’ x 2’ -’ x n’ °) 

1 z n 

= PxX x \’ @)PxS x 2’ 6)'"Px 

1 z n 

= (l -0) [x”=i x r n ]e n . 

Then, the log likelihood function is given by 


Thus, 


n 


In L{x x ,x 2 , 


//lnZ(xj, x 2 , ■ 

~d0~ 


X G 




+ n\n(). 




-1 n 

+ o' 


By setting the derivative to zero, we can check that the maximizing value of 9 is 
given by 



n 



Thus, the MLE can be written as 



n 



Problem 5 
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Let X], X 2 , X 3 , . .., X n be a random sample from a Uniform^ 0, 9) distribution, where 9 is 
unknown. Find the maximum likelihood estimator (MLE) of 9 based on this random sample. 

• Solution 

o If Xj ~ Uniform^ 0, 9), then 


f/x) 



o<x<e 

otherwise 


The likelihood function is given by 

L{x x ,x 2 ,--,x n ,9) =f x .x 7 -x( x l’ x 2 ’ -’ x n’ d ) 

1 z n 


~ fx } ( x I ’ ®)fxS x 2’ 



0<x x ,x 2 ,-,x n <d 

otherwise 


1 

Note that — is a decreasing function of 6. Thus, to minimize it, we need to 

choose the smallest possible value for 9. For i = 1,2,... ,n, we need to have 
9 > x, Thus, the smallest possible value for 9 is 


0 ML = max (xy,x 2 , ••*, x n ). 
Therefore, the MLE can be written as 

&ml = max ( x i’ x 2’ 


Note that this is one of those cases wherein 9 ML cannot be obtained by setting the 

derivative of the likelihood function to zero. Here, the maximum is achieved at an 
endpoint of the acceptable interval. 


previous 
next —> 
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